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The ability to precisely quantify time on the scale of 
hundreds of milliseconds is critical towards the proces- 
sing of complex sensory and motor patterns. However, 
the natures of neural mechanisms for temporal proces- 
sing (at this scale) in the brain are mostly unknown. 
Based on experimental data (psychophysics, cell cul- 
tures, electrophysiology) and theoretical studies, it is lar- 
gely debated whether dedicated circuits or intrinsic 
mechanisms of neural circuits underlie the timing pro- 
cess [1]. One specific type of timing model, namely 
state-dependent networks (SDN) [2], shows that time is 
encoded in the temporal patterns of activity of neural 
populations and emerges from the internal dynamics of 
recurrent networks. This can be achieved without the 
need of dedicated timing units. However, such intrinsic 
models in their present form have difficulty accounting 
for crossmodal transfer [1]. In contrast, recent experi- 
mental evidence indicates that medial premotor cortical 
neurons of behaving monkeys show specific interval 
tuning across modalities (auditory and visual) [3]. In this 
work we propose a hybrid model, making the hypothesis 
that dedicated interval tuning mechanisms of individual 
neurons augment the intrinsic dynamics of large recur- 
rent networks (dynamic reservoir). Using a network 
model of rate-coded neurons starting with random initi- 
alization of synaptic connections, we propose a learning 
rule based on local active information storage (LAIS) [4] 
to adapt neuronal time constants with respect to the 



input stimuli to the network. Measured at each spatio- 
temporal location of the reservoir, LAIS gives a prob- 
abilistic measure of the amount of information in the 
previous state of the neuron that is relevant in predict- 
ing the next state. Interestingly high LAIS regions in the 
network correlate to significant events in time (intervals) 
of the driving stimulus. Furthermore, we combine this 
with mutual information driven intrinsic plasticity 
scheme in order to stabilize chaotic activity in the net- 
work. Incoming input drives the network which, in turn, 
is connected to readout neurons (Figure l.A) that dis- 
play the learned behavior for temporally dependent sen- 
sory motor tasks. Reservoir-to-output connections can 
be adapted using both supervised and reward modulated 
learning rules. Using single and multiple interval discri- 
mination tasks, we show that our network reproduces 
(across modalities) a linear increase in temporal variabil- 
ity with increase in interval duration. This correlation is 
also observed in experimental data [3]. Furthermore we 
demonstrate that our dedicated timing mechanism com- 
plements the inherent transient dynamics of the net- 
work by successfully learning complex time dependent 
motor behaviors; like handwriting generation (Figure l.B 
and C), locomotion pattern transformation and temporal 
memory tasks. In essence, our hybrid model demon- 
strates that time can be encoded by a combination of 
dedicated and intrinsic mechanisms with the possibility 
to 'learn' the temporal structure of incoming stimuli [5]. 
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Figure 1 Interval timing dependent handwriting generation task using a reservoir of 3000 rate-coded neurons. A. Basic structure of the recurrent 
neural network with input, reservoir and output connections for a temporal pattern generation task (inset shows single reservoir neuron 
properties). B. Inputs to the reservoir consisting of 26x2 dimensions (x and y co-ordinates of alphabets a-z) and an additional auxiliary input fixed 
at 1.0 (not shown), inputs are given as a brief stimulus of 210ms. C. Network learns to write the word 'memory' cursively. The desired trajectory 
is shown in black and color coding indicates the exact interval of time when each letter is generated. Intervals from 500ms up to 5000 ms are 
successfully learned. 
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